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ABSTRACT 


Current technology provides a means to obtain sampled data that digitally 
describes three-dimensional surfaces and objects. Three-dimensional digitizing 
cameras can be used to obtain sampled data that maps the surface of three 
dimensional figures and models. Data obtained from such sources enable accurate 
renderings of the original surface. However, the digitizing process often provides 
much more data than is needed to accurately recreate the surface or object. In order to 
use such data in real-time visual simulators, a significant reduction in the data 
needed to accurately render the sampled surfaces is required. The techniques 
presented were developed to drastically reduce the number of data points required to 
depict an object without sacrificing the detail and accuracy inherent in the digitizing 


process. 
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I. INTRODUCTION 


As our technologically oriented civilization becomes increasingly more complex 
and sophisticated, the cost of training operators and technicians becomes more costly 
and time consuming. Inexpensive, three-dimensional simulators are important 
visualization tools that can provide an attractive alternative or supplement to 
traditional training methods [Ref. 1]. In order to be effective, these simulators must 
provide a sense of realism to the trainee; a real-time three-dimensional environment 
is an important contributor to this sense of realism. A need exists for realistic three- 
dimensional models of actual real world objects—ships, aircraft, automobiles and 


other vehicles—for use in these simulators. The use of a three-dimensional digitizing 


camera to obtain data from scale models can be used for this purpose. Such data 
provides an accurate depiction of objects used in the simulators [Ref. 2]. However, 
these images can contain several hundred thousand polygons—far too many polygons 
to be drawn in a real-time simulation without the use of very specialized and costly 
hardware. A semi-automated technique was sought for drastically reducing the 
number of polygons required to depict an object in real-time on relatively inexpensive 
hardware without sacrificing the detail and accuracy provided by the digitizing process 


[Ref. 3]. 


A. BACKGROUND 

Many of the ongoing projects in the Graphics and Video Laboratory at the Naval 
Postgraduate School deal with the creation and use of low cost, real-time visual 
simulators [Ref. 1; Ref. 4; Ref. 5; Ref 6]. Currently, simulators exist for land, air, sea 


and undersea vehicles which run on the Silicon Graphics IRIS-4D/GT series of 


graphics workstations and make extensive use of the graphics capabilities of these 
machines. Recent work has focused on increasing the usefulness and effectiveness of 
the projects by incorporating real-world terrain data, including topography from digital 
survey databases, as well as reflectance and cultural feature information from 
photogrammetrically processed stereo-pair aerial photographs [Ref. 7]. These 
simulators, for example, now allow one to pilot a ship on the waters of the Sea of 
Japan, or to drive a jeep across the terrain of Fort Hunter-Liggett, California. 

These efforts have been very important in adding to the visual realism of these 
simulators. However, there is still a need for realistic vehicles to inhabit them. 
Previously, vehicles were drawn up by hand on sheets of graph paper and 
painstakingly converted into polygonal representations for use in the programs. This 
technique is tedious, time consuming, error prone, and highly dependent upon the 
artistic talents of the individual creating the sketches. In order to overcome these 
problems, a project was undertaken to provide the vehicles in these simulators the 
same degree of accuracy and detailing as that available from using digital topography 


information for the terrain models. 


B. THREE-DIMENSIONAL DIGITIZER 

Cyberware Laboratories of Monterey, California produces a 3D digitizing camera 
that was used for data collection. It performs a cylindrical or linear scan of an object 
and produces a data file consisting of up to 1 million sample points that form a mesh 
that maps the surface of the object. In the case of the cylindrical scan, the mesh 
consists of radius values measured at uniformly spaced latitudes and longitudes 
around the object being digitized. The resulting mesh is identical to that produced by 
the lines of latitude and longitude drawn on a model globe. Borrowing from this 


analogy, it is convenient to visualize and discuss the data points in terms of their 


latitude and longitude, and to use the terms north, south, east and west to express 
relationships among the sample points. The linear scans produce a mesh that 
resembles the grid on a sheet of graph paper; however, the terminology from the 
cylindrical scan is retained for consistency. It should be noted that the spacing 
between neighboring sample points is not necessarily the same along both latitudes 
and longitudes, nor are the number of samples the same in both directions. 

A schematic diagram of the camera’s operation is shown in Figure 1. A low 
power laser is directed through a series of lenses and mirrors to create a plane of light 
that is projected onto the subject. Mirrors view the reflected light from both sides of 


the subject in order to alleviate any problems caused by shadowing. These images of 





Subject 


Figure 1. Schematic View of Cyberware Digitizer 


the surface contour are combined at a half-silvered mirror and reflected into the lens 
of a high resolution CCD camera. The image is then processed by additional circuitry 
to extract the contour information and relay it to the controlling computer. The entire 
apparatus is mounted on a revolving framework so that it rotates around the subject 
creating a cylindrical scan of the surface contours. Alternately, small subjects can be 
moved past a stationary camera to produce linear scans of the subject. The most 
recent version of the camera is able to produce a 512 x 512 grid of sample points at a 
resolution of 0.7 millimeters in 15-20 seconds. 

By using the shading and lighting models on the IRIS workstation, the renderings 
of these digitized objects are very realistic. We currently have scans of objects from 
simple geometric shapes to complex and detailed ornamental carvings, with an 
average of over 110,000 data points (see Photos 1-5 in Chapter IV). However the 
drawing capabilities of the IRIS workstations are not sufficient to allow models of this 
detail to be used in real-time 3D visual simulators. Therefore a method for reducing 


the number of data points required to accurately render an object was needed. 


C. SOLUTION TECHNIQUES 

There are two basic approaches to solving this problem, as shown in Figure 2. 
The first, and probably more straightforward, method is to systematically add or 
delete polygons from the object being rendered until the desired realism is obtained or 
the system’s capabilities are exceeded. The second approach is to specify how many 
polygons the final object is to have, and then try to find the combination of polygons 
that gives the best rendering with that number of polygons. In either case, realism of 
the rendering must be balanced against drawing complexity and speed. The number of 
polygons to be drawn is a reasonable metric to be used in determining drawing 


complexity; however, a similar metric is not available to measure the realism of the 
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Figure 2. General Approaches to Data Reduction 


rendering. For this reason, the techniques are not completely automated. The user is 
tasked with viewing the results of the data reduction and determining whether or not 


the realism is sufficient for the purpose at hand. 


Il. ADAPTIVE SUBDIVISION 


In their paper, Schmitt et. al. describe an adaptive subdivision method of fitting 
surfaces to sampled data [Ref. 8]. The technique approximates the surface 
represented by the sampled data points with bicubic Bernstein-Bézier surface 
patches. By constraining the patches to be continuous with neighboring patches, the 
coefficients of the patch can be determined. An accuracy metric is then used to 
measure the closeness of the approximating patch to the actual data. If the 
approximation is not within a user specified tolerance, the patch is subdivided into 
four smaller patches. The process is then recursively performed on these sub-patches 
until the set of patches approximates the sampled data to within the specified 
tolerance. 

This technique has a useful property with respect to the simulator work being 
done in this laboratory—the method yields a reduction in the number of data points 
required to approximate the surface of a 3D object. By adjusting the method’s 
tolerance, the user can make the approximation as accurate as necessary (limited by 
the precision of the digitizing process). However, the IRIS-4D/GT series of graphics 
workstations does not support the rendering of filled and shaded bicubic surfaces, 
instead the graphics engine supports high performance rendering of polygonal 
surfaces. For this reason, the methods presented here use simple polygons to 


approximate the surface of a 3D object. 


A. BASIC METHOD 
The basic adaptive subdivision method as presented by Schmitt et. al. is 


sketched in Figure 3. Sketch 3a shows several data points produced by the sampling 


(a) Mesh of data points. 


(b) Trial polygon. 


(c) Measuring the errors. 


(d) Trial polygon after subdivision 





Figure 3. Surface-fitting Polygons with Adaptive Subdivision 





process and sketch 3b adds a trial polygon that approximates the surface represented 
by the sample points. Due to the regularity of the mesh represented by the data 
points, the polygon is uniquely determined by noting the latitude and longitude of the 
northeast and southwest corners; these latitudes and longitudes form an index into 
the array of data points. 

A bilinear interpolation is performed over the surface of the approximating 
polygon to locate the point on the surface ‘directly below’ a sample data point. The 
distance (or error) between the surface and the data point is then calculated, as 
shown in Figure 3c, and is compared to the user specified tolerance. If any of the 
errors exceeds the tolerance value then the polygon is divided into four smaller 
polygons, as shown in Figure 3d, and the process is repeated recursively. 

When the approximation to the data is within the specified tolerance, the 
recursion is terminated and the polygon is saved in a linked list. Upon completion of 
the subdivision algorithm, the resulting polygons are displayed for the user to judge 
the results. Generally, the user runs the program repeatedly while varying the 


maximum tolerance until the results are suitable. 


B. SHORTCOMINGS OF THE BASIC METHOD 

Although the basic adaptive subdivision method provides a good starting point 
for this work, it has several shortcomings when polygons are used in place of bicubic 
patches in approximating the surface. 

1. Edge Gaps 

In {Ref. 8] the authors use bicubic Bernstein-Bézier surface patches to 

model the data. The transitions across patch edges to neighboring patches are 
guaranteed to be smooth and continuous due to the constraints applied when solving 


for the patch control points. 





Edge gap 


Figure 4. Edge Gaps 


This is not the case when using polygons to approximate the data. As 
shown in Figure 4, it is very likely that the edges of neighboring polygons will not 
coincide. The result is that when the object it rendered using the polygonal 
approximation against a background of contrasting color, holes can appear where 
these edge gaps exist. 

2. Simplistic Subdivision 

The algorithm presented by Schmitt, et. al. always subdivides the surface 
patch into four smaller patches along the latitude and longitude passing closest to the 
center of the patch. Such subdivision proved sufficient for their purposes and results in 
a simple and fast procedure. However, when used for surface-fitting with polygons, it 
can leave artifacts in the final rendering. Additionally, the characteristics of the 


sampled data are not used to intelligently guide or optimize the subdivision process. 


The artifacts left by the basic subdivision method are similar to the creasing 
problem encountered with some methods for creating fractal mountains [Ref. 9 and 
Ref. 10]. Due to the regularity of choosing the division point of the polygons, the 
edges and corners of adjacent polygons tend to line up with each other. This can 
create ‘creases’ in the surface of the final rendered object, causing the surface to 
appear unnatural. 

3. Aliasing 

There are two forms of aliasing that can occur when rendering the reduced 
data. The first results when an edge gap is viewed tangentially (Photo 1). This 
causes the outline of the rendered object to have a stair-step appearance. Data sets 
generated with large accuracy tolerances are much more susceptible to this effect 


than those with small tolerances. 





Photo I. Aliasing Due to Edge Gaps. 
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Figure 6. The cause of aliasing 


The second form of aliasing results from the use of the IRIS’s lighting 
models. The raw data produced by the Cyberware digitizer represents a mesh of 
sampled data points in a 512 x 512 grid. However, the volume scanned by the 
digitizer is usually taller than the subject. This causes the highest and lowest 
latitudes of the data grid to contain zero or meaningless values. Such latitudes are 
usually trimmed off when the raw data is edited and the data mesh is no longer 
square. In such a case, many of the approximating polygons become very long and 
narrow, as shown in Figure 6. The shading routines essentially calculate the correct 
shade at the vertices of the polygon and then use interpolation to determine the 
shading of the interior of the polygon. When several of these strip-like polygons are 
adjacent to a larger polygon, there can be a noticeable step in shading between the 
small polygons and the larger polygon. This problem can be minimized by using 
material definitions with low values of specular reflectance [Ref. 11] and by using 


small tolerances. 


C. VARIATIONS ON ADAPTIVE SUBDIVISION 
As described above, there are several weaknesses in using the basic adaptive 


subdivision method for building polygonal approximations to sampled surface data. In 
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order to overcome these weaknesses and to investigate alternative strategies, 
several variations were developed. Each variation is coded as a separate module, and 
the modules can be combined in many ways as shown in Figure 7— one module from 
each level. There are three basic ways in which the subdivision procedure can be 
modified—keep extra vertices or extra polygons to fill the edge gap, divide a polygon 
into two parts instead of into four parts, or change the way in which a polygon is 
actually subdivided. 
1. Filling the Edge Gap 

The first level of variations deals with the problem of edge gaps appearing in 
the reduced-data renderings. These gaps can be dealt with in several different ways. 
First, depending upon the accuracy required of the final rendering and the texture of 
the subject’s surface, the edge gaps may not be visible and therefore no corrective 
action is necessary. Thus the corners_only module makes no attempt to fill the edge 


gaps, and was used in the original program that pointed out the edge gap problem. 


main 
corners-only extra-vertices fill-triangles 


divide-by-2 divide-by-4 


divide-randomly divide-at-center 





divide-at-largest-error divide-at-first-error divide-at-max-curvature 


Figure 7. Adaptive Subdivision Variation Hierarchy 
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However, most of the test cases have demonstrated the need for filling these edge 
gaps. 

One possible solution is to create additional polygons to fill these gaps as 
illustrated in Figure 8a. These extra polygons are created by connecting vertices lying 
along a common latitude or longitude with vertices that are also the corners of an 
adjacent polygon. The disadvantages of this solution are that more polygons are 
created which raises drawing complexity and these fill polygons lie in a plane 
perpendicular to the object’s surface. 

The alternative solution to the problem of edge gaps is to retain extra 
vertices along the edge of a polygon as needed to keep the edge gaps from appearing. 
In Figure 8b, the larger polygon contains the center vertex in the mesh as well as its 
four corners points. Note that only those vertices along an edge that are also corner 


vertices of neighboring polygons need to be retained. This approach has the drawback 


(a) 






Extra polygon 
to fill gap 


(b) 


This polygon has 
five vertices 


Figure 8. Filling the Edge Gap 


i 


of increasing the average number of vertices per polygon in the rendered object, but 
also has several benefits. First, little extra data storage is required since the extra 
vertices in the edge of one polygon are the corner vertices of a neighboring polygon. 
Second, the lighting capabilities of the IRIS automatically fill the gaps with the correct 
shade depending on material, light(s), etc. And third, because vertex normals are 
used with the lighting model, the shading appears smooth across polygon boundaries. 
2. Number of Sub-Polygons 
In the original version of the polygon-surface-fitting procedure, a polygon 
was always subdivided into four smaller parts. This often resulted in long thin 
polygons that degraded the appearance of the rendered image. As a means to 
alleviate this problem, a variation of the algorithm was programmed to divide a 
polygon into two sub-polygons. In this case, the decision to divide along a latitude or 
a longitude could be based on which dimension of the polygon is greater—north-south 
or east-west. 
3. Subdivision Locations 
The remaining variations of the adaptive subdivision technique all concern 
the choice of how to subdivide a polygon that does not meet the accuracy specified by 
the user. This accuracy is measured as the distance from the surface of the 
approximating polygon to each sample data point being approximated. In each case, 
the accuracy of ali the data points ‘over’ the polygon are checked; as soon as one 
distance exceeds the tolerance, the subdivision method is invoked to determine 
where the polygon should be split. 
a. Center Subdivision 
This is the subdivision method used by the original adaptive subdivision 


technique. No effort is made to analyze the data points in order to intelligently choose 
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a point through which to subdivide a polygon. Instead the algorithm simply finds the 
center latitude and longitude of the polygon and divides it along those lines. 
b. First Error 
In determining the accuracy with which a polygon represents a group of 
sampled data points, the distance from the polygon’s surface to each data point is 
measured and compared to the tolerance. Depending upon the dimensions of the 
polygon, these points are checked in a north-to-south/west-to-east or a west-to- 
east/north-to-south manner. The checking of the data points terminates when a 
measurement exceeds the tolerance, and the latitude and longitude of the offending 
point are used to divide the polygon. 
c. Greatest Error 
This version is similar to first error, except that accuracy measurement 
does not end when an error measurement exceeds the user specification. Instead, the 
process is continued so that the point of maximum error can be found. Upon 
completing the accuracy check, the latitude and longitude of the point of maximum 
error are used to subdivide the original polygon. Note that this slows down the 
procedure due to the large number of comparisons which must be made. 
d. Maximum Curvature 
In attempting to intelligently choose a point to divide a polygon, consider 
how it might be done manually. An obvious place to put an edge of a polygon is along 
an apparent edge on the surface—such as along the edge of a cube. For a computer 
algorithm, detecting these edges is not a simple task. However, for the adaptive 
subdivision to work, the exact edges are not needed. 
Consider the mesh of data points resulting from digitizing the surface of 
a cube and picture the normal vectors associated with each such data point. The data 


points that lie on the top side of the cube will have normal vectors that are all parallel 
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Edge of Interest 


Figure 9. Normal Vectors on Opposite sides of an Edge 


to each other (or nearly parallel). As shown in Figure 9, this will not be the case for 
the normal vectors of data points that lie on opposite sides of an edge. Therefore, the 
angle formed between the normals of nearby data points gives an indication of how 
sharply the surface is curving. 

In this method, before the subdivision begins, each data point is 
assigned two ‘curvature’ measures—one in the north-south direction and the other 
east-west. These measures are based on the length of the vector resulting from the 
subtraction of the normal vectors for the data points on either side of the data point 
being considered (see Figure 10). Then during the subdivision process, the location of 
maximum ‘curvature’ is found in much the same way as the point of maximum error 
was located above. The latitude and longitude of this point then become the dividing 
lines for the new polygon. Because one of the points at the corner of a polygon will 


always have the highest curvature (since it was chosen as the place to subdivide the 
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Figure 10. Vector Difference to represent Curvature 


previous polygon), the corners should be excluded from the scan in order to prevent 


an infinite recursion. 


Cy 


Ill. POLYGON GROWTH 


Another method to systematically generate surface-fitting polygons is to use a 
polygon growth technique (Figure 2). First a seed polygon is selected from the 
original set of data, as in Figure 1la. Then a neighboring polygon is selected and the 
two are combined into a larger trial polygon (Figures 11b and c). If the trial polygon 
passes the accuracy metric, additional neighbors are selected in an attempt at further 
growth, as in 11d through g. When all attempts at further growth fail, the polygon is 
added to the list of polygons describing the reduced object, as shown in Figure 11h. A 
new seed polygon is selected and the process repeated. When there are no more 
polygons from which to choose a new seed, the process is terminated. Variations on 
this method include using a random or a sequential selection strategy for the next 


seed polygon. 


» 






Figure 11. Polygon Growth 
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This method of fitting polygons to the sampled data did not prove as useful as the 
adaptive subdivision methods, for several reasons. First, it is an essentially brute 
force method of surface fitting and very repetitive in nature. Many trial polygons are 
created, only to be ‘thrown out’ because they exceed the error tolerance. This causes 
the procedure to execute quite slowly—orders of magnitude more slowly than the 
adaptive subdivision methods. Second, the data is not significantly reduced. Many of 
the generated polygons are of complicated shapes and use a large number of vertices. 
Thus many of the original sample data points are retained, increasing storage 


requirements and slowing drawing times. 
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IV. RESULTS 


This project was undertaken to investigate possible methods for creating 
realistic ships, trucks and other inhabitants of the real-time 3D visual simulators 
being developed at the Naval Postgraduate School. The majority of the research 
efforts were directed at developing the adaptive subdivision techniques, since this 
area seemed most promising for near term results. 

The general test procedure consisted of viewing renderings of both the full data 
set and of a reduced data set. The data reduction program was repeated while the 
tolerance was adjusted based on trial-and-error and experience in order to achieve a 
good balance between the accuracy of the rendering and its drawing complexity. This 
process was then repeated for each of the variations of the adaptive subdivision 
method. The quality of the final renderings is necessarily a subjective judgement 
made by the user; however, every effort was made to be consistent across all of the 
reduction variations for each test subject. 

Tables 1-5 give the results from applying the adaptive subdivision variations 
discussed in Chapter II to a number of different digitized test objects. Table 1 
contains the results from a digitized bust of Spock. Tables 2 and 3 are from a 
motorcycle helmet and a paint tube respectively; while the last two tables are from 
linear scans of a telephone and of an ornamental carving. Photo 2a shows a rendering 
of Spock’s bust with the full set of sampled data points while Photo 2b shows the 
rendering of the reduced data. Similarly Photos 3-6 show before and after renderings 
of the other test objects. Lastly Photos 7 and 8 show the wireframe of the reduced 


paint tube and carving respectively. 
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Each table records various measures of the algorithm’s performance. The 
uppermost row lists values for the raw data, and each of the other rows gives the 
results after applying the variation indicated. Spec is the tolerance value used with 
that particular adaptive subdivision method. The columns labeled polys and vrtcs list 
the number of polygons and the number of vertices retained from the original sampled 
data set. Since in the extra vertex and fill polygon variations of the adaptive 
subdivision technique, the polygons may not have four vertices per polygon, the 
number of polygons and the number of vertices only give a partial evaluation of the 
complexity of the final rendered object. In order to get a better estimation of 
complexity, the number of calls to the IRIS’s graphics library are also tabulated (g/ 
calls). 

The data structures used for storing the object consists of a table of vertices and 
a linked list of polygons. Each vertex structure in the table contains fields for the 
x/y/z-coordinates and the i/j/k-components of the unit normal vector at that vertex. 
The polygon structures are maintained in a linked list and contain a pointer to an array 
of pointers to entries in the vertex table. The mem column in the tables give the 
number of bytes needed to store such a data structure. 

The fill polygon variation builds small polygons to fill in the edge gaps in between 
the other polygons. The f p and fv fields of the tables list the number of extra 
polygons used, and the number of extra pointers into the vertex table that are 
required. Thus they give an indication of the extra graphics library function calls 
required of this variation. Note that the fp polygons are also included in the poly 
total. 

The adaptive subdivision variations themselves are listed down the left side of 
the charts. The first letter of each code designates how the subdivision point is 


chosen—c is center; f is first error; g is for greatest error; r is randomly selected, and 
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m is for point of maximum curvature. The remaining letters indicate the other levels in 
the variation hierarchy (Figure 2)—e designates that extra vertices are retained, 
while f and 2 indicate creating fill polygons and subdivision-by-two respectively. 
There are no entries for the combination of divide at point of first error and subdivision 
by two. This is because the location where the error measure exceeded the specified 
tolerance was very often along one edge of the polygon; effectively subdividing by 
two. The renderings of the elementary variations—c, f, g, r and m as well as their 
divide-by-two variations are generally of poor quality due to the presence of gaps. 
However, the data is included as a reference for measuring the overhead caused by 
the edge gap treatments. 

The general results indicate that for data from objects with rough, complex 
surfaces, the best results are obtained when the strategy of subdivision at the point 
of greatest error is used, and extra vertices are retained in order to fill any edge 
gaps—ce or c2e. This is not surprising, since such subdivision tends to reduce the 
measured error quickly. However, in some cases, this method results in a loss of 
detail in areas where the surface has sharp edges. This is readily apparent near the 
button edges in the linear scan of the telephone (Photo 5). In these cases, the center 
division variations ce and c2e can sometimes give better results, as in the case of the 
ornamental carving (Table 5 and Photo 6). 

Better results were expected from the strategy of dividing at the point of 
maximum curvature—me, The idea seems to work well in areas of rapidly curving 
surfaces, but begins to suffer in areas that are relatively smooth and flat. In such 
areas, the difference between adjacent normal vectors tends toward very small 
values, possibly smaller than the digitizing camera’s resolution, causing the choice of 


the subdivision point to become more random. A hybrid technique that uses curvature 
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based subdivision for the first few levels of recursion and then switches to a greatest 


error technique when the surfaces become nearly flat may improve these results. 
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first letter: divide at center, first error, greatest error, 
maximum curvature or random point 


other letters: fill edge gaps with extra vertices or fill polygons, 
and divide-by-2 instead of by four 


notes: holes due to edge gaps 
artifacts of long narrow polygons 


Table 1. Results of Data Reduction on Bust of Spock 
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Photo 2. Bust of Spock in Profile 
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first letter: divide at center, first error, greatest error, 
maximum curvature or random point 


other letters: fill edge gaps with extra vertices or fill polygons, 
and divide-by-2 instead of by four 


notes: holes due to edge gaps 
artifacts of long narrow polygons 


Table 2. Results of Data Reduction Motorcycle Helmet 
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(a) Full data set 
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Photo 3. Motorcycle Helmet 
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first letter: divide at center, first error, greatest error, 
maximum curvature or random point 


other letters: fill edge gaps with extra vertices or fill polygons, 
and divide-by-2 instead of by four 


notes: holes due to edge gaps 
artifacts of long narrow polygons 


Table 3. Results of Data Reduction on Paint Tube 
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(a) Full data set 
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Photo 4. Tube of Paint 
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first letter: | divide at center, first error, greatest error, 
maximum curvature or random point 


other letters: fill edge gaps with extra vertices or fill polygons, 
and divide-by-2 instead of by four 


notes: holes due to edge gaps 
artifacts of long narrow polygons 


Table 4. Results of Data Reduction on Linear Scan of Telephone 
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(a) Full data set 


(b) Reduced data set 
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Photo 5. Telephone 
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first letter: divide at center, first error, greatest error, 
Maximum curvature or random point 


other letters: fill edge gaps with extra vertices or fill polygons, 
and divide-by-2 instead of by four 


notes: holes due to edge gaps 
artifacts of long narrow polygons 


unable to get adequate rendering 


Table 5. Results of Data Reduction on Linear Scan of Ornamental Carving 


32 


(a) Full data set 


(b) Reduced data set 





Photo 6. Ornamental Carving 
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(a)Wireframe of 
paint tube 


(b) Wireframe of 
ornamental carving 





Photo 7. Example Wireframes 
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V. FUTURE DIRECTIONS 


The polygon-fitting techniques discussed thus far create a polygonal surface that 
approximates sampled data by ‘adding’ polygons until the approximation falls within 
a user specified tolerance. The user can control the accuracy of the final rendered 
object, but cannot directly control the final number of polygons (by running the 
procedure repeatedly and ‘tweaking’ the tolerance, the user can zero in on the desired 
number of polygons). In many cases, it would be desirable to specify that the final 
approximation consist of a given number of polygons and have the data reduction 
procedure return the best approximation using that number of polygons. 

This second approach to the problem can be viewed as a search. The nodes of the 
search correspond to sets of P polygons to be used in the rendering, and the search 
space consists of all possible combinations of those P polygons out of the N original 
polygons. The goal of the search then is to find the set of polygons that best 
approximates the original data. Because the problem is combinatorial in nature (ie. 
the search space grows as the factorial of N) brute force search techniques would not 
be feasible for most real world problems, therefore techniques borrowed from the 
artificial intelligence field such as simulated annealing and the use of heuristics are to 


be investigated [Ref. 12 and Ref. 13]. 


A. SEARCH 

In trying to find the best approximation to the original data, one is trying to 
minimize an error function (i.e. maximize the accuracy). One approach to minimizing a 
function is to choose a possible solution and evaluate the function. By carefully 


changing the function’s arguments in small increments, its value can be made to 


38 


Error(x) 


Local Minimum 


Global Minimum 





Domain of Error(x) 


Figure 12. Local Minima in an Error Function 


decrease. When no further changes to the arguments results in a decrease in the 
function’s value, a minima has been found. 

A problem that arises with this incremental improvement strategy is that this 
procedure can become trapped at a local minimum, and therefore never find the global 
minimum (Figure 12). This is because since only changes that move closer to the goal 
(minimum error) are allowed, there is no way of climbing over a small ‘hump’ in the 
function’s value. One way to minimize this effect is to repeat the incremental 
improvement process many times, each from a different starting points and simply 
retaining the best solution. However, this can fail if the minimum is located in a 


narrow ‘valley’ in the error curve. 


B. SIMULATED ANNEALING 
Simulated annealing is similar to the incremental improvement technique except 


that ‘uphill’ excursions are allowed in a controlled way. An initial guess for the best 
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solution is formed and evaluated. The best solution is then randomly permuted in an 
effort to improve it. If the permutation results in a lower error, then it becomes the 
new best solution and the permutation/evaluation cycle is repeated. If the new guess 
has a higher error, a probability function is used to determine whether to replace the 
current best solution. 

The probability is determined by a system parameter called the system 
temperature. During the initial stage of the algorithm, the temperature is high and the 
probability that a more costly solution is allowed to replace the current solution is 
also high. As the process continues, the temperature is gradually reduced and the 
system ‘cools’. This results in a lower probability of keeping a solution that is ‘uphill’ 
from the current one. Eventually, the system freezes and no more changes are 
possible; the current guess is then the solution. 

At high temperatures, the solution is allowed to make many long random uphill 
jumps, effectively conducting a broad survey of the search space. As the system 
cools, the uphill jumps get progressively smaller and less frequent until the system 
freezes. Since all better solutions are accepted and only some of the poorer guesses 
are accepted, the overall trend is a movement toward smaller errors. The occasional 
‘uphill’ excursion helps keep the solution from getting stuck at a local minimum. 

Simulated annealing does not guarantee the most optimal solution, but it has 
been used effectively to obtain near-optimal solutions for very large and complex 
problems [Ref. 12]. By choosing an initial set of polygons with which to render a 
digitized object and permuting this set in a consistent way, this technique may be 


useful in data reduction efforts. 
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C. HEURISTIC SEARCHES 

Stochastic search techniques such as simulated annealing examine a large 
number of states in the search space, and because each candidate successor state is 
randomly generated, they spend a great deal of time examining candidates that are 
worse than the current best ‘solution’. In fact, at low system temperatures, simulated 
annealing programs spend a large fraction of their cycles examining these worse 
states. A heuristic search is designed to minimize examining extra states and instead 
to concentrate on search paths that look particularly promising. The next candidate 
solution to process is picked based on some rules that weigh the costs and benefits of 
the different possible choices. At each stage, the best looking candidate is chosen. At 
the same time, it is possible to eliminate or prune candidates that look bad, or look 
worse than the current solution by some threshold value. 

If we consider the solution to be a set of P polygons, then our method for 
generating candidate solutions might be to exchange a polygon in our set P with one 
not in the set. A possible heuristic to use in choosing which polygons to exchange 
would be to swap out the polygon with the largest curvature (i.e. is most nearly flat) 
with one that has a small curvature. Similarly, we may instead chose to rank the 
edges or vertices to discover which vertices, edges, and polygons carry more 
meaning, etc. The idea is to use one’s knowledge about the system and the problem 


in order to more quickly guide the program to the solution. 
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VI. CONCLUSIONS 


Current work on this project has focused on the systematic generation 
approaches to the simplification of rendered objects. Both adaptive subdivision and 
polygonal growth methods have been implemented, along with several of the 
variations. The initial results are very encouraging; sample data of a human bust 
consisting of over 110,000 points was successfully reduced to just over 9,000 
polygons using the extra vertex-greatest error variation of the adaptive subdivision 
method (ge) (as in Figure 8). This drastic reduction in object complexity resulted in 
an order of magnitude increase in drawing speeds. Further investigation into 
improving the accuracy metrics, and into rules concerning how to subdivide a polygon 


should result in greater reductions. 


Other issues include: 


* loss of features that are finer than the digitizing camera’s resolution, 

¢ methods of combining several sets of data from the camera for objects too 
large to digitize in one pass, 

* being able to have different accuracy metrics for different parts of the same 
object (e.g. when working with a digitized bust, may want to require 
higher accuracy in the area of the face than in the back of the head), 

* automatically adjusting the tolerance based on surface features, 

* using surface color information that will be provided by the next generation 
of the Cyberware Laboratories rapid digitizer, 

* defining boundaries for areas of an objects surface, so that simplification 
occurs within these boundaries. This would allow assignment of colors to 
parts of the object without fear of a polygon crossing from one color to 
another, 

¢ eliminating the artifacts produced by the subdivision methods, 

* improving execution times of the polygonal growth technique, 

* investigate various data structures for storing and manipulating the 
objects. 
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These issues represent areas of current investigation; for the future, research 
into the use of search techniques will be expanded. Small scale programs written to 
learn and experiment with these technique need to be scaled up and adapted to the 
data reduction problem. Effective heuristic rules need to be devised in order to allow 
such techniques to be used efficiently, and ways of measuring how accurate a 
rendering will look to a user need to be investigated. 

Our goal is to be able to use these processes to create models for the simulators 
developed here at NPS. By using the digitizing process on scale models, the design, 
creation, and coding of vehicles and other objects for these simulators can be made 
easier, faster, and more realistic. Initial results are good, indicating that this is a 


promising area of investigation. 
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